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Abstract 

In this paper, we investigate communication strategies for the multiple access channel with 
feedback and correlated sources (MACFCS). The MACFCS models a wireless sensor network 
scenario in which sensors distributed throughout an arbitrary random field collect correlated 
measurements and transmit them to a common sink. We derive achievable rate regions for the 
three- node MACFCS. First, we study the strategy when source coding and channel coding are 
combined, which we term full decoding at sources. Second, we look at several strategies when 
source coding and channel coding are separated, which we term full decoding at destination. 
From numerical computations on Gaussian channels, we see that different strategies perform 
better under certain source correlations and channel setups. 

1 Introduction 

In this paper, we investigate the the multiple access channel with feedback and correlated sources 
(MACFCS), as defined in pQ. This channel combines the multiple access channel with correlated 
sources (MACCS) and the multiple access channel with feedback (MACF). It consists of multiple 
sources which send possibly correlated data to a single destination. At the same time, each source 
receives feedback from the channel. 

The MACCS (with a common part) was studied by Slepian and Wolf who derived an 
achievable rate region. In their paper, separate source coding and channel coding are used, where 
source coding is first performed to remove the correlation between the two sources and then 
channel coding for the multiple access channel (MAC) with independent sources is employed. The 
MACCS (with possibly no common part) was considered by Cover et al. They showed, by 
using a simple example, that separating source and channel coding is not optimal and derived an 
achievable rate region for the MACCS. 

The MACF (with independent sources) was investigated by Cover and Leung @]. In their 
model, there are two sources and all nodes, i.e., the two sources and the destination, receive the 
same channel output. A year later, Carleial 5 further generalized the channel to the case where 
each node receives a different channel output signal. 

1.1 Channel Model 

Combining the MACF and the MACCS, we get the MACFCS, depicted in Figure^ The three-node 
discrete memoryless MACFCS is denoted by (<Si x S2,p(si, Sa)> x <^2,P*(yi, 2/2, Va\xi, £2), 3^1 x 
3^2 x 3^3)- si 6 Si and s 2 G S2 are the source messages to nodes 1 and 2 respectively and they are 
drawn from the discrete bivariate distribution p(si,S2). Here, Si , 1S2 , X± , X2 , 3^1 , 3^2 , and 3^3 are 
seven finite sets. p*(yi, y 2 , U3\xi, £2) defines the channel transition probability on 3^1 x 3^2 X 3^3 for 
each [xi, x 2 ) £ Xi x A2. Xi and x 2 are the inputs to the channel from nodes 1 and 2 respectively. 
2/2, and 2/3 are the channel outputs to nodes 1,2, and the destination respectively. We say that 
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Figure 1: The 3-node multiple access channel with feedback and correlated sources. 



the random variable pair (Si, S2) can be reliably transmitted to the destination if the probability 
that the destination wrongly decodes a pair of (Si, S2) eSfx S% in each n channel uses can be 
made arbitrarily small, for large n. 

1.2 The Gaussian MACFCS 

In the T-node Gaussian MACFCS (G-MACFCS), the channel outputs are given by 



r * = Ev K ^"^ + ^' t=l,2,...,T, (1) 

1=1 
ijtt 

where Y t is the received signal at node t. Xi is the signal transmitted by node i, with power 
constraints E[Xf] < Pi. Z t is an independent, zero- mean, Gaussian random variable at the 
receiver of node t with variance N t . k is a positive constant and r\ is the path loss exponent, da 
is the distance between nodes i and t. We assume perfect echo cancellation, meaning that a node 
can cancel its own transmission perfectly. 

Murugan et al. jS] looked at a similar problem, assuming Gaussian channels and a total average 
power constraint on both sources. Their coding approach is based on joint source-channel coding 
using time division multiple access (TDMA) with the nodes operating in half-duplex. Our work 
differs from [H] in that we consider general channels (including discrete memoryless and Gaussian 
channels) with full-duplex nodes, in which the source nodes can transmit and receive simultane- 
ously. For the Gaussian case, we impose individual power constraints on the sources. We consider 
both joint and separate source-channel coding strategies. 

In brief, we classify coding strategies for the MACFCS into two categories: full decoding at 
sources and full decoding at the destination. We describe these strategies in more detail in the 
following sections. The rest of the paper is organized as follows. In Sectional we derive achievable 
rate regions for the MACFCS using a full decoding at sources strategy. In Section |3 we derive 
achievable rate regions for the MACFCS using full decoding at destination strategies. We compare 
the performance of the different strategies in Section 0] 

2 Full Decoding at Sources 

For full decoding at sources, the general idea is for the sources to communicate so that each source 
has full information about what the other sources have. They then cooperate to send the signal 
coherently to the destination. Each source node transmits cooperative information of the previous 
block (which it decodes from other nodes) and new information (which is to be decoded by other 
sources and the destination) in one block. 

We consider the following correlation structure in which the sources have a common part to 
send. Let /, J, and K be three independent random variables. Node 1 receives Si — (I, J) and 
node 2 receives S2 — (I, K). 
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Figure 2: Coding for the multiple access channel with feedback and correlated sources using the 
decode-forward strategy. 



We note that node 1 does not know K and node 2 does not know J. The idea here is for node 
1 to decode K (from node 2's transmission) and for node 2 to decode J. After decoding, both 
nodes have the full information (/, J,K). Each node then sends the fully decoded information as 
well as its new received information that is unknown to and to be decoded by other nodes. In 
summary, node 1 sends (J, I' , J' , K 1 ) and node 2 sends (K, I' , J' , K'), where prime denotes the 
previous block's information. Using this strategy, we have the following theorem. 

Theorem 1 In a three-node discrete memoryless MACFCS, the source messages (Si,S 2 ) can be 
reliably transmitted to the destination if the following hold: 



H(S U S 2 ) <I(X 1 ,X 2 ;Y 3 \Q), 

H(Sx\S 2 )<mm [/(X i; Y 2 |Q, W , Wi, W 2 ,X 2 ),I{Wx;Y a \Q, W 0) W 2 ) 
H(S 2 \Si) < min 



I{X 1 ;Y 3 \Q,W ,W 1 ,W 2 ,X 2 ) 
I(X 2 ;Y 3 \Q,W ,W 1 ,W 2 ,X 1 ) 



I(X 2 ;Yx\Q, Wo, Wi, W 2 , XJ, I{W 2 ; Y a \Q, W 0) Wi 
I(Sv,S 2 ) < I(W ;Y 3 \Q,W U W 2 ), 

H(Sx) < /(Wo, Wv,Y 3 \Q, W 3 ) + I(X i; Y 3 \Q, W , Wi, W 2 ,X 2 ), 
H(S2)<I(W ,W2;Y 3 \Q,W 1 ) + I(X 2 ;Y 3 \Q,W ,Wi,W2,X 1 ), 
H{Sx\S 2 ) + H(S 2 \Sx) <7(W 1 ,W2;Y 3 |Q,Wo)+7(X 1 ,X 2 ;y 3 |Q,Wo,W 1 ,W 2 ), 

where p(q, x 1 ,x 2 ,y 1 ,y 2 , y 3 , w , Wi,W 2 ) = p(q)p(w \q)p(w 1 \q)p{w 2 \q)p(xi \q, w , Wi,w 2 ) 
p(x 2 \q,Wo,wi,w 2 )p*(yi,y 2 ,y 3 \xi,x 2 ,x 3 ). Wq, Wi and W 2 are auxiliary random variables. Q is 
the time sharing variable. 



We note that by setting 



Q = : W = 0, Wi = 0, W 2 = 0, X 2 = 0, 
Q = 1 : W = 0, Wi = 0, W 2 = 0, X x = 0, 
Q = 2:X 1 = /(W , Wi, W 2 ), X 2 = f(W , W 1: W 2 ), 



(3a) 
(3b) 
(3c) 



for some deterministic function /(•), we end up with the half-duplex coding scheme in [§]. In the 
decoding in [oj, the destination only decodes at time Q = 2. In other words, they exclude the 
terms /(• ■ • ; Y 3 \Q = i, ■ ■ ■ ) for i = 1, 2. In Theorem^ the destination decodes for all Q = 0, 1, 2 
and hence the rate achievable can be higher. 
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Sketch of proof for Theorem fTJ' We give an outline of the proof for Theorem ^ We ignore Q 
in the following discussion to simply the expressions. Using Slepian and Wolf's Theorem 2 in [J], 
when node 1 only knows Si — (I, J) and node 2 knows 62 = (/, K), node 1 can encode J using 
H(Si\S 2 ) bits and it can decoded by node 2. Similarly, node 2 can use H(S2\S{) bits to encode 
K. 

Now, we explain the auxiliary random variables used. Referring to Fig. [3 Wq carries the 
common information from the previous block, W% carries node l's private information from the 
previous block, while W 2 carries node 2's private information from the previous block. In each 
block of transmission, node 1 needs to decode node 2's new private information. This can be done 
reliably if -ff (S^l-Si) < I(X2', ^i|Wo, Wi, W2, X\). Similar, node 2 needs to decode node l's private 
information and this can be done reliably if H(S\\S2) < I(Xi;Y 2 \Wo, W\, W2, X^. 

At the destination, the common information can be reliably decoded if I (Si; S2) < I(Wq;Y 3 \Wi, W2). 
Node l's private information can be reliably decoded over two blocks if H(Si \S 2 ) < I(Wi;Y 3 \Wq,W2) + 
I(Xi; Y 3 \Wq, Wi, W2, X2). Similarly, node 2's private information can be reliably decoded over 
two blocks at the destination if ff(S 2 |£i) < I(W 2 ;Y 3 \W ,W 1 ) + I(X 2 ; Y 3 \W , Wi, W 2 , Xi). To 
ensure that node l's message, node 2's message, nodes 1 and 2's common parts, and nodes 1 
and 2's messages can be reliably decoded at the destination, the following need to be satisfied 
respectively. 

H(Si) < I(W ,Wi;Y 3 \W 2 ) + I(Xi;Y 3 \W ,Wi,W 2 ,X2), 

H(S 2 ) < I (W , W 2 ; Y 3 1 Wi ) + I(X 2 ; Y 3 1 W , Wi , W 2 , X x ) , 

H (Si I S 2 ) + H (S 2 1 Si ) < I( Wi , W 2 ; Y 3 \ W ) + I(X t , X 2 ; Y 3 \ W , Wi , W 2 ) , 

H(Si,S 2 )<I(X 1 ,X 2 ;Y 3 ). 

The total probability of error can be bounded for large n if the equations above hold. Hence, we 
have Theorem n 

We note that in our derivation, we use a correlation structure with an explicit common part for 
clearer illustration. However, the analysis can be generalized to the case where there is no common 
part, and hence Theoremncan be proven for sources with any arbitrary correlation structure. 

3 Full Decoding at Destination 

For full decoding at the destination, source coding is first performed at every source node using 
the technique described in This removes the correlation among the sources. 

At this point, we have turned the problem into channel coding for the MACF with independent 
sources. An achievable region of the MACF was obtained by Carleial [Ej- We call that the partial 
decode-forward strategy. In this paper, we find another achievable region for the MACF using the 
compress- forward strategy (see Section 13.40 . Combining the rate constraints of the source coding 
(for correlated sources) and the channel coding (for the MACF), we arrive at other achievable 
rate regions for the MACFCS. To the best of our knowledge, the compress-forward strategy has 
not been studied on the MACF. Ignoring the feedback of the MACF, we can combine the source 
coding with correlated source and channel coding for the MAC and arrive at yet another set of 
achievable rates. 

3.1 Source Coding for Correlated Sources 

Source coding for correlated sources is performed prior to channel coding for MACF. First, we 
consider a noiseless channel. With node 1 knowing only Si, node 2 knowing only S2, the destination 
can reconstruct (Si, S2) reliably if node 1 encodes Si with rate Ri and node 2 encodes S2 with 
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Figure 3: Coding for the multiple access channel with feedback (with independent sources) using 
the compress-forward strategy. 



rate R 2 where 

Ri>H{S 1 \S 2 ), (5a) 

Ri > H(S 2 \S 1 ), (5b) 

Ri+ R 2 > H(S 1 ,S 2 ). (5c) 

3.2 Combining with Channel Coding for the MAC 

The simplest way of performing channel coding after source coding is to use that of the MAC. 
In this case, we disregard the feedback of the channel to the source nodes. Each source now 
simple sends independent messages as it would in the MAC. In this case, the source nodes do not 
cooperate. The capacity of the MAC can be found in [H] and [H] • Combining these results and the 
source coding constraints, the messages (Si,S 2 ) of the MACFCS can be reliably transmitted to 
the destination if the following hold. 



where p(xi,x 2 ) = p{x 1 )p{x 2 ). 



H{S 1 \S 2 )<I{X 1 -Y 3 \X 2 ), 
ff(5 2 |5i) < J(X 2 ;y 3 |*i), 
H{S U S 2 ) </(A 1 ,A 2 ;r 3 ), 



(6a) 
(6b) 
(6c) 



3.3 Combining with Partial Decode-Forward for the MACF 

An achievable rate region for the MACFCS can be derived by combining the source coding rate 
constraints f l|5a|l - lf3c|) in Section l3~T|) and the channel coding constraints for the MACF ((3a), (3b), 
(7a)-(7q) in [5]). We call the strategy used in jS] the partial decode-forward strategy. The proof 
that this rate region is achievable is straightforward. 

3.4 Combining with Compress-Forward for the MACF 

In this section, we derive an achievable rate for the MACF using the compress-forward strategy. 
Combining this with the source coding rate constraints in Section l3~Tl we derive another achievable 
rate region for the MACFCS. 
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Using the compress-forward strategy, each node transmits independent information as well as 
a quantized and compressed version of its received signal. Referring to Figure 01 J and K are 
independent information after source coding. Consider node 1 as an example first. From the 
received signal Y±, it produces a quantized version Y±. It then compresses Y\ to U\. In the next 
block, it sends new information J as well as U\. We can view this as node 1 helping node 2 to 
send a noisy, quantized, and compressed version of node 2's signal, K , without needing to fully 
decode K. Node 2 does likewise. 

Combining the source coding the correlated sources and compress-forward channel coding, we 
can show that the following theorem. 

Theorem 2 In a three-node discrete memoryless MACFCS. The source symbols (Si,S 2 ) can be 



reliably transmitted to the destination if 

H{S 1 \S 2 ) < I(X 1 ;Y 1 ,Y 2l Y 3 \Q 1 U 1 ,U 2 ,X 2 ) 1 (7a) 

H(S 2 \S 1 ) < I(X 2 ;Y 1 ,Y 2 ,Y 3 \Q,U 1 ,U 2 ,X 1 ), (7b) 

H(S 1 ,S 2 ) < I{X 1 ,X 2 ;Y ll Y 2 ,Y 3 \Q,U ll U 2 ), (7c) 



where the mutual information is taken over all joint probability mass functions 
p(q,u 1 ,u 2 ,x 1 ,x 2 ,y 1 ,y 2 ,y 1 ,y 2 ,y 3 ) = p(q)p(u 1 \q)p(x 1 \q,u 1 )p(u 2 \q)p(x 2 \q, u 2 )p(y 1 \q,y 1 ,x 1 ,u 1 ) 
P(y2\q,y2,x 2 ,u 2 )p*(yi,y 2 ,y 3 \xi,x 2 ), subjected to the following constraints 

I{U X ■,Y 3 \Q,U 2 )>I{Y l -,Y l \Q,X 1 ,U 1 )-I{Y 1 -,Y 3 \Q,Y 2 ,U Xi U 2 ), 
I(U 2 ; Y 3 \Q, U x ) > 7(Y 2 ; Y 2 \Q, X 2 , U 2 ) - I(Y 2 ;Y 3 \Q, Y u Ui, U 2 ), 

i(Ui,u 2 ;Y 3 \Q) >/(y i; y 1 |Q,x 1 ,c/ 1 ) + /(f 2 ;y 2 |g,x 2 ,c/ 2 )-/(y 1 ,f 2 ;r 3 |Q,c/ 1 ,c/ 2 ). 

Here, Ui,U 2 ,Y\, and Y 2 are auxiliary random variables. Q is the time sharing variable. We ignore 
Q in the following discussion to simply the expressions. 

Sketch of proof for Theorem 0' Now we give an outline of the proof for Theorem [3 We use 
R±, R 2 to represent the rate (after source coding) from nodes 1 and 2 respectively. R\ and R 2 
represent the rate of the quantized version of the received signals of nodes 1 and 2 respectively. 
R[ and R' 2 represent the compressed of the quantized signal of nodes 1 and 2 respectively. Node 
1 quantizes its received signal to Y\. It can do this reliably if R\ > I{Y\\ Y\\X\, U\). Similarly for 
node 2 to quantizes its received signal, R 2 > I(Y 2 ;Y 2 \X 2 ,U 2 ). Nodes 1 and 2 then compress the 
quantizes information and send them to the destination. The destination can decode the com- 
pressed information {Ui,U 2 ) if R[ < I{Ui,Y 3 \U 2 ), R' 2 < I(U 2 ',Y 3 \Ui), andR[+R 2 < I{Ui,U 2 ;Y 3 ) 
hold. After decoding the compressed information, the destination finds the quantized information 
Y\ and Y 2 . The following inequalities must be satisfied. 

Ri < IiY^Y^ U U U 2 ) + R[, (9a) 
Ri <I{Y 2 ; Y 3 \Y U U 1 ,U 2 )+ i4 (9b) 
Rt+R 2 < I{Yx,Y 2 ; Y Z \U X , U 2 ) + R[ + R' 2 . (9c) 

After decoding the quantized information, the destination uses Y\,Y 2 , and Y 3 to decode the source 
messages. This can be done reliably if 

Ri<I(Xi\Y x ,Y it Yz\Ux,U2,X2), (10a) 
R 2 <I{X2- i Yx,Y 2i Y 3 \Ui,U i ,Xx) 1 (10b) 
R l +R i <I{X 1 ,X 2 ;Yx,Yi,Y i \Ux,U2). (10c) 

Combining these rate constraints for the MACF using the compress-forward strategy and the 
constraints for the source coding, (|5a|l - lf3c|) . we get Theorem [21 
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Figure 4: Minimum power required to transmit Figure 5: Minimum power required to transmit 
(si, s 2 ) to the destination per channel use, with (s\, s 2 ) to the destination per channel use, with 



weak inter-source link. 



weak source-destination link. 



4 Numerical Computations 

In this section, we plot and compare the powers required to transmit data on the three-node 
G-MACFCS using different strategies. Although Gaussian channel input distributions may not 
be optimal, we choose X\, X 2 , and the auxiliary random variables to be Gaussian for the sake of 
comparison. We also assume that Theorem|5J which uses the compress-forward strategy, holds for 
Gaussian random variables 10, Remarks 28,30]. 

Figs. ^ and show the minimum average transmit powers required for nodes 1 and 2 to 
reliably transmit a pair of discrete messages (Si, S 2 ) per channel use. We fix the sources to have 
the following structures: H{Si\S 2 ) = H(S 2 \S 1 ) = I(Si;S 2 ) = 0.5. 

When the inter-source link is weak (Fig. 0|, full decoding at destination with the compress- 
forward strategy (MACFCS-CF) and separate source-channel coding with MAC channel cod- 
ing (MACCC) perform better than full decoding at sources with the decode-forward strategy 
(MACFCS-DF). It can be seen from the graph that less power is required using MACFCS-CF 
and MACCC compared to MACFCS-DF. Using MACFCS-DF, each source node needs to get full 
information of what other nodes transmit. This imposes an extra constraint on the transmit power 
at the source nodes. 

When the source-destination links are weak (Fig. EJ), MACFCS-DF performs better than 
MACFCS-CF and MACCC. This is because the transmission bottleneck is now at the source- 
destination link. Coherent combining is possible using MACFCS-DF and it yields a significant 
gain in the rate on the source-destination link. 

The staircase behavior in Fig. ^ is caused by different inequalities governing the overall achiev- 
able rate in Thcorcm^a-nd optimization of Since the region is non-convex, time sharing 
enlarges the region. 

We note that in Figs. H and MACCC performs slightly better than MACFCS-CF. This 
can be explained using Fig. [|J1 which shows the smallest feasible N% or N 2 required for a certain 
channel setup, Pui, and Pvi- Recall that Pm is the power allocated to transmit the compressed 
information (old message) to the destination while Pyi carries new information. We note that 
Pm + Pvi = 10. From the graph, we see that when we allocate more power to Pui, more power 
is used to transmit the compressed message. In this case, the compression noise Ni is smaller. 
When all transmit power is used allocated to Pjji, no power is used to transmit new messages 
and hence the overall transmission rate is zero. In the figure, the rate is maximized when we set 
Pm —> 0. When we allocate all transmit power to Pvi, we are essentially doing channel coding for 
the MAC. However, a large Ni (— > 00) is required when Pjji — » 0. Hence the rate we obtain using 
MACFCS-CF approaches that of MACCC when P m -> 0. 

MACCC does not always perform better than MACFCS-CF. The latter outperforms the two 
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Figure 6: Achievable rates of the compress- 
forward strategy on the three-node G- 
MACFCS with equal node distance and 
smallest feasible Ni(=N2). 
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Figure 7: Minimum power required to transmit 
(si, sa) to the destination per channel use, in a 
linear topology where node 2 is closer to the 
destination. 



other strategies when node 2 is placed closer to the destination than to node 1. This is depicted 
in Fig. In short, our numerical computations indicate that the performance of the different 
strategies varies with the channel settings. 
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